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Presented is the final report of the 3 year reading 
curriculum development project (funded under Title VI) for 40 
educable mentally handicapped children in Wakulla County, Florida, 
which centered on the development of computer assisted (CAI) 
instructional materials in a programed format. . Described for the 
first year of the program is formative evaluation of reading 
materials, all of which were presented by the computer. The second 
year i? explained to have J^ein devoted to converting from the CAI 
mode ' -to computer managed instruction in which only periodic testing 
was done by computer while off-line instruction was provided by 
lesion booklets. The entire system of supplementary instruction is 
said to have been presented without the computer during the third 
year. Following are some of the conclusions of the program: 
additional materials on word attack skills were found necessary, EMR 
students appeared to need even more repetition and drill than 
originally thought, significant gains were demonstrated by the 40 
students for whom complete data were available r and students who took 
more time in responding to test items ,on the computer tended to 
demonstrate more gains in 6b jectives passed on the posttest. 
Appendixes include samples of -original -and revised programed formats r 
the test^ttsed for pretest and posttest r program memos regarding 
computer procedures r and a project questionnaire. . (DB) 
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SECTION I. INTRODUCTION 

This document is a final report of the second year of the 
^ Wakulla County Title VI-B Project, Reading Curriculum Development 

Project. The purpose of the pro-jcpt was to develop reading materials 
which could be used to supplement instruction in classrooms for 
educable mentally retarded (EMR) children. * 

As' originally conceived the first year^wuuld be devoled Lo tuxm- 
ative evaluation of reading materials in a. .computer-assisted instruc- 
tion (CAI) mode. All materials were presented by 'the computer via 
a teletype in the classroom. The second year was to be devoted to 



. converting .from the CAI mo^e to .computeiwrian^god instruction (CMJ) 

mode, in whrch -on ly periodic testing was to be conducted via the 

' *» . ■ fl ■ 

computer and off- line instruction would be provided by lesson booklets. 

.During the third year the entire system of supplementary instruction. 

was to be presented without the computer. 

In this document there is a summary of Year I activities (See 
Section II) , and evaluation of the three project objectives for Year II. 
In Sectoort* T T T . F. v,i I \ :p. tinn-oT T± j cl I Objective A, i^uilcu Lkc-~ 
evaluation of the development of individualized, computer-managed 
reading materials. This includes determirption of a hierarchy of 
Vobj &c trives --.y revi si on and addition of material*;, description of the CMI 
materials 5 ,' .the branching" technique, format; of off-line lessons, the 
pretest, and reliability of on-line lessons. 

lry Section IV, Evaluation- of Project Objective 2,- is reported 
the evaluation of the efficacy of CMI reading materials. This section 
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-includes analysis of the pretest in terms- of validating the sequence 
of objectives and as p. -diagnostic placement instrument, -description 
of the EMR. students , classroom procedures, performance on the , " 

posttest , variation between classrooms, and recommendations for \ 

i, • " 

• • • • \ 

improvement of the materials. f - . ^ 

In Section V, Evaluation of Project Objective 3, is reported 'Jhe 

exploration of an approach to intel lectual evaluation of .the mentally 

■ * • * . * ' • . "* 

iLtr.i UUU l^rtJlH.-! U 'f.l. ir « J * ' O HI*-' tflllJ|tUUl.b II IV/ J I L t. VJ 1. ,1 1 1£ GI'll p V X « V.' X Met ' t V.. f." . 

' assessment capabilities ^of CAI-CMI. 

In Section VI, Summary of Conclusions, the evaluation of all 
V^spects of the. project are reported in brief form. 



SECTION' II. SUMMARY gjp DEVELOPMENT DURING INITIAL FUNDING PERIOD - '-. 

During the first year of this project a computer-assisted (CAT) 
reading program v;as employed in four classrooms of educablc mentally 
retarded (EMR) students. As information regarding pupil performance 
became available, various experimental prototypes were developed for 
identified deficiencies in the' mat erials . During the second year - 
tho mntcvr-lnls were revised and reorganized \to meet the demonstrated 
needs of EMR students, additional experimental prototypes were de- 
veloped, and presentational format was °revised in order to- convert 
from a CAI mode to a computer-managed (CMI) jnode. . 
Descrip tion of the Original Reading Mat erials. The basis for the 
sequential reading materials for the educable mentally retarded was - 
a set of instructional units developed for computer-assisted in- 
struction. The program was written for a remedial and enrichment 
reading program, covering grades one through six, with grade one 
having three levels. It is these first three levels which are, of 
most importance to the Wakulir. EMR project. The rationale for their 
d c v e ^ o r ^^" o n t ~~td t^** ^pot^nti-*" 5 ! for th^ir use ,-i ith ° ^ p \'Td . g'ld"'" ^^^^ 
will be discussed briefly. 

The origin of the materials was in a study by Hansen and Rodgers 
(1965), which was concerned with the vocalic center group, or VCG. 
The VCG is termed the "minimal construct defined over a set of phono- 
tactic rules," and it defines cons.tx a \ n t s \ not only between continuous 
elements (i.e., consonant-consonant, consonant-vowel, vowel-consonant) 
but over discontinuous elements such as pre- and post-vocalic consonants 



Material development was pursued orr the basis of various' aspects of 
givqn VCG's: the ease of the rehearsal, the ease of association of 
the phonotactic (sound) patten to the orthographic (written) pat- 
tern; and the prediction of types of errors the initial reader would 
make in forming pronunciations for a particular graphic segment. 

On this structure, the reading program was developed to include, 
in grade one, three major categories with choice, of words depending 
upon the VCG restrictions noted above. First; a set of lessons was 
devisejd to cover who-what questions. Second, form classes were 
covered, and third, synonymy* lessons were introduced. 

Instructional strategies used in the original <CAI program were 
devised for the average school population, and .these were considered 
inappropriate for educable mentally' retarded learners . The skills 
themselves, however, are considered as suitabje to EMRs as to general 
school learners. The changes made were ,dn- methods of instruction 
rather than in the skills themselves. 

Descrip tion of the CAI\ Program (Year 1) , .The basis for the sequential 
reading mate^-ini w«s the, VCG-based CAT progrn™. which had been, written 
as a remedial and enrichment reading program for the general school 
population. The reading program included, in grade one, three major 
categories with choice of words depending upon the VCG sequencing 
based on aspects noted. previously . One set of lessons was devised to 
cover, within the vocabulary sequencing requirements, who-what ques- 
tions. A second -.covered form classes, and a third, synonymy. All of 
these vv^re .at the entering level, and were preceded in the actual pro- 
gram by a set of lessons in letter matching. 



The, learner who completed the beginning lessons was moved into 
the second level, or grade, of .reading comprehension, fit this level 
and all remaining levels, each unit was composed of a reading passage 
of continued reading difficulty 3 plus seven to fifteen questions of 
a" similar difficulty level. The passages ranged from approximately 
100 words at the lowest level, to almost 300 at the most difficult 
(grade six) level. Questions were based on three comprehension 
skills ^informational recall, inferential processes, and evaluative 
processes. Within these categories, a total of 25 different types 
of questions were repeated, with Votabulary sequenced and restricted 
by the VCG prescriptions and a reading difficulty formula. — ■ 

Revisions during the 'first year occurred at two lgvels. First, 
curriculum revisions regarding the increases in difficulty of the 
reading materials themselves had to be adjusted. Second, the method 
of presentation via computer terminal required modification to suit 
the, characte risti cs of the EMR. learner. 

"Three 'major curriculum innovations were implemented during the 
first yeav^o^o pc i a-i ton , adapting the program to . the EMR learner's 
needs for very small steps in the progression -of learning tasks, 
much repetition, and co.nstant reinforcement. The first of these 
involved the construction of a new level of material within the 
structure of the original CAI reading materials; The original ma- 
tcrials consisted of four levels of reading lessons as described 
previously. In addition to the stepped increase in difficulty be- 
^ tween levels, successive lessog^. r withip each level were graded in 
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difficulty, which provided the student with reading experience in 
gradations of increasing 1 difficulty. Evaluation from prior ad- 

c 

ministrations of the materials, however, led to the construction 
of new level bridging a gap between the third and fourth levels. 
This was a move toward providing smaller steps in learning mater- 
ials for EMR learners. 

The second development v/as based on the finding that approxi- 
mately one-third of the students could not "do the basic lessons 
without excessive failure. This called for development of small 
steps, repetitive units covering simple words and word parts pre- 
sented for the student to match with one of a set of alternatives. 
The curriculum was augmented by 50 lessons at this point. 

The third maj or" curriculum innovation was implemented during 
the first year .to insure that meaning was being acquired from 
printed words. Pictures were used to help the students attach 
meaning to the orthographic symbols they were already successfully 
matching. The success of the use of these materials, both statis- 
tically and by observation, led to the adJiliuu uf numerous mater 
ials during the second year. 

Revisions in the presentation via computer terminal involved 
decisions related to timing and feedback, i.e., how long to allow 
for a response, how many chances to give a correct response, what 
type of information is given as feedback following a correct or 
incorrect answer, etc. The first change in the computer strategies 
was to eliminate the timing constraints in the origins j program, 



thereby providing the EMR learner with adequate time to respond to 
a question. First, a one minute time out was tried,, and then the 
program was changed to allow the learner as much time as he needed- 
to respond. 

Decisions on feedback for the EMM were based partially on the 
Noonan and~Barry (1967) findings that noninstitutionalized retnrdates 
perform better under social reinforcement (that is, positive comments 
such* as "well done," or T *good answer 11 ) . Consequently, the computer 
•feedback was finally modified so that it no longer contained "Wrong" 
or "incorrect , n for wrong answers, but responded with n The correct 
answer is j rr The correct answer feedback was developed to pro- 
vide much stronger reinforcement" than the original, containing a 
number of phrases of praisey specials groups of stars for certain 
correct answers, and for every lesson-score of 80% or above, the com- 
puter terminal printed out a smiling face at the end of the lesson. 

a 




EVALUATION OF PROJECT OBJECTIVE 1. 



As stated in the proposal the first project objective was to 
"develop individualized, computer-managed reading materials based 
on learners performance on CAT reading materials produced during 
the initial year of the project." 

Computer-managed instruction (CMI), the method : of presentation 
during the second year of the project, differed considerably from 
CAI . Under CMI only testing was presented via the computer termi- 
nal with instruction conducted off-line by programmed lessons. 
Under the CAI mode all instruction had been presented via the com- 
puter terminal and a student was branched .to a more or less' diffi- 
cult lesson on the basis of his score on each lesson. Under CMI 
mode, a pretest via the computer _ terminal was given for a number 
of lessons and the individual was assigned the amount of instruc- 
tion which appeared necessary on the basis of that pretest score. 

« In order to convert the. reading materials from th3 CAI to the 

CMI format, the order of presentation was restructured, the mater- 
ial^ voro reorganized and revised, ncv: materials were developed, . d 
a branching system for the computer prescriptions was ...developed, 
and a written pretest covering all objectives in the CMI curri- 
culum was prepared. * 

Under CAI the lessons had bc^n arranged by level of difficulty 
in two dimensions as shown in Figure 1. During CAI it was possible 
to use. the two dimensions of difficulty, (difficulty of skills and 
difficulty of content level) in the. branching procedures; however, 
it was apparent that such a complex system would not be feasible 



under CMI . It was, therefore, necessary (1) to deduce the hierarchy 
of skills from the CAI date, (2) to name the objectives in the 



I ncrease in Difficulty of Skills 



Increase; in 
Difficulty of 
Content by 
Level 



1110 


1111 


'1112 


< 

1113 . 


1210 


1211 


1212 


1213 \ 


1310 


1311 


1312 


1313 ) 


' 1410 


1411 


1412 


1413 ) 


2110 


. 2111 


2112 • 


2113 \ 



1180 



1280 



1380 



1480 



2180 



Figure 1 . Matrix' of Lessons Showing 

Increases in Difficulty under CAI mode,. . , 

hierarchy, and (3)- to regroup and revise materials in accordance with 
the objectives, . 

An examination of the materials and of the student evaluations 
from Yeaa^I revealed several deficiencies. In each lesson a student . 
might work with any number of objectives. Sometimes, he might work 
with the s^me objectives for several lessons in succession, but some- 
times each successive lesson might involve different objectives. 
Many 4 of the items were far too difficult or inappropriate for EMR 
students. Some questions were vague, and some had more than one'oj 
no clear answer. It was difficult to discern the pattern for in- 
cluding objectives in the lessons. Some apparent objectives were" 
represented by two or fewer item s. It v^as also difficult -to dis- 
cern by inspection the criteria used to determine the difficulty of 
particular items, since identical items could be found on several 
difficulty levels. Low scoxjs of EMR students in level 1200 seemed t 
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indicate a shortage of materials of lesser difficulty, although thp! ; 
data might have been due to the branching system used under CAI pre- 
sentation. 

Feedback from teachers of E"MU students indicated that more ob- 
jectives in the area of decoding skills were needed. The picture-.- 
word matching study performed during Year I suggested a technique 
for simulating an oral response to printed materials. 
Hierarchy of Objectives 

The objectives which "were deduced from the Year I -materials are 

shown in Table 1 in their assumed hierarchical order .\ 

\ 

Table 1. Obj ectives for EMR reading Materials 



Objective , Sample Item 



Objective 100 

Given a stimulus letter, the 

student will choose from a 

list the letter which is the same, 

as the stimulus. ■ 

(Source: h'AK-2) 


A 

■ • ' ' \ 
. .. " \ 

1. C 

2. B ■ ; 

3. A 


Objective ?00 


CAN 


Given a stimulus word, the student 




will t choosc from a list the word 




which is the same as the sti- 


1. MAN 


mulus. 




(Source: WAK-2) 


2. — CAN 




3. CAR 


Objective 500 

Given a stimulus word, the stu- 
dent will choose from a group 
of puctures ^the picture tl " t 
illustrates the stimulus. 
(Source: WAK-3) 

ERIC 


CAT 

... :-.D... x 

2. C-i-o^- , 



Obj ectives Sample Item 



Objective 400* 

Given a stimulus letter, the stu- 
dent will choose from a group of pic- 
tures the pucturc that illustrates 
a word that includes ,thc sound of 
the stimulus. < i , . 
(Source: '. New) " 11 K:i Ul - 1 L 


B 


Objective 500 

Given a stimulus phrase, the stu- 
dent will choose from a list the 
phrase which- is -the same as Jthe 
stimulus. ■* 
(Source: KAK-2) 


THE FAT CAT 

1. THE BIG PIG 

2. THE FAT CAT 

3. THE LITTLE KITTEN 


Objective' 600 '"r "" 
Given a stimulus phrase, the stu- 
dent will choose frbm a group of 
pictures the picture -"that illus- 
trates the stimulus. V. 

(Source : New) ' s • 

- ■ '" . ■ -v' 


THE RUNNING BOY 

'•it ' 

3. p* * 


Objective 700 

°Given^a short stimulus sentence, 
the student will choose from a 
1 i s t th e s en t c t± c e whjlch_ is s ameT - 
as the stimulus. 

. (Source : ■ Nov, - ) — ■ 


SAM PLAYS BALL. 

1 . 0 TWO BOYS CAME . 

2. SHE IS HAPPY . 

3. SAM PLAYS BALL. 


Objective 800 

Given a short sti" \lus sentence, the 
student will choose from a group of 
pictures the pucturc which illus- 
trates the stimulus. ' 
(Source: New) 


THE BOY IS SITTING 

i:rfi 
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Obj ective ■ Sample Item 



Objective 900 

Given a sentence and a question 
- about.. the content of the sentence, 
~" the student will choose an answer 
from a list . 
(Source: . WAK-1) ~ 


THE MAN CAN RUN. 
WHAT CAN THE MAN DO? 

1. SIT 

1 2. SEE 
S . RUN 


Ob j ectJ^^l CtO£U 

Givciv a phrase with a blank space, 
the student will choose from a 
list a word that would be appro- 
priate in the blank sp#ce. \ 
(Source: IVAK-l) 


THAT DOG. 

1. BOX ' • 

2. HAT 

3. BAD 


Objective 1100 

Given a stimulus word and its opposite, 
the student will choose from a list a 
word that is opposite to the stimulus; 
(Source: WAK-1) 


THE OPPOSITE OF GIRL 
IS BOY. 
' WHAT IS THE OPPOSITE 
OF GIRL? .... 

1 . HELLO 

2 . AFTERNOON 

-.*• 

3. BOY 


Objective 1200 

Given a stimulus word, the student 
will choose from a list, a word 
that is opposite to the stimulus. 
(Source: .WAK-l) 


WHAT IS THE OPPOSITE 
OF HELLO? 

1. GOOD-BYE ' 

2. AFTERNOON 
3.. SMILE 
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Objective 




Sample Item 


Objective 1300 




SAM WAS PLAY I NO FOOTBALL 


Given a simple two or three sentence 




IN THE GARDEN. THAT MADE 


story and a question about the con- 




HIS MOTHER MAD. WHO "WAS 


tent, the student will choose an 




HOI HER ANGRi WI-lH? 


answer from a list. 






(Source: h'AK-1) 










1. SAM 






2. MOTHER 




c 


3. THE PLAYERS 



Subobjectix r cs : The student will 

a. Recognize key words. 

b. Recognize synonyms of key words. 



3. Recognize a key idea- even if a sentence has- undergone a syntactical 
transformation. 



Objective 1400 

Given a simple story between three 
to ten sentences in leivgth and a 
question about 'the content, the 
student will choose an answer from 
a list (several questions may be asked 
about the content of one story) . 
(Source: WAK-1) 
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Polar bears live in the. 
Arctic, near the North Pole. 
You might think it's too cold 
to live there, but the bears 
don't mind the cold weather. 
They swim, play; eat, and hunt 
in. the ice-cold water. 
' The polar bears have thick 
fur coats and layers of fat to 
keep them warm. Also, thdre is 
some oil in the. fur. the oil 
jjici.kc;i> uie water rull off. 

• What ki.:d of weather does 
a polar bear like. 



1. HOT 



COLD 



3. WARM 



14. 



Objective 



Sample Item 



Objective 1500 

Given a short sentence or para- 
graph, the student Kill choose 
from a list an inferred answer 7 
to a question about the paragraph, 
(Source: Ncwju 



J0E ! S FATHER IS ALWAYS BUYING 
.BOOKS. WHERE ARB THE BOOKS 
KEPT? " ~ 



1. ON THE BHD 

2. ON. BOOKSHELVES 

3. ON THE BREAKFAST TABLE 



TV 
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for each objective. Some- materials for objectives 900, 1000, 1100, 
1200, 1300, 1400 could be drawn from the original materials of Year I, 
■called WAK-1. Some materials for objectives 100, 200, and 500 could 
be dra\m from the matching materials of WAK-2. The objectives indi- 
cated additional types of skills which appeared to be needed. 
REVISION AND ADDIT I ON OF MATERIALS , ^ 

Careful examination of Year I materials during the pr*Q£,ess of re- 

v a r 1 

• ^ ' p M ; j I _ I 

organizing the content, served to highlight the proBTems nrteffed earlier, 
and it was found that extensive work was needed. The majority of ma- 
terials were extensively revised or completely new. Only for objec- 
tives 9G0 and iOOO was there very- little revision necessary. 

In making "revisions or in developing new material vocabulary and 
content-ideas were drawn from the following sources:' 

a. A list of i^ords recommended by teachers during Year I, 

b. The vocabulary lists from The Design for Daily Living , a 
source for EMU instruction, 

c. The 100 most important words listed by Clarence R. Stone 
r in Progress in Primary Read ing, 
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,d. The 300 most important words listed by Edward Fry in 
"Developing A word .List for Remedial Reading" in Ele- 
mentary English , . • 

e. The materials from the WAK-3 word-picture matfching Study. 
W 

Description of CMI Materials, The materials themselves arc 
_. — i. . 

composed of lessons containing ten questions 5 each, progressing in 
one or more parameters of difficulty for each objective. Number of 
lessons per objective varies, although the structure by objective 
does not. The first lesson in each objective is considered a pre- 
test. .for the next four-lessons, and is presented at the computer 
terminal. The student sees a question,' responds with his answer, 
receives favorable feedback or is simply given the^correct answer 
when he misses. This procedure is untimedj giving the student 
time to ask questions of the aide or teacher, or to study the cor- 
rect answer until he has satisfied himself. At the end of the 
lesson, the student was given his score, with a smiling face if he 
scored, over 80%. He was free to tear off this paper printout and 
keep it in a notebook, or further study it. 

Branching Technique . Before the student was Isigned-of f ,•- tJjfef.. 
computer terminal printed out his next assignment, based on the 
mastery level he had shown in the assessment. If a student scored 
60% or below, he was assigned to study the next four paper-and- 
pencil units before reporting back to the terminal lor further . 
assessment. If he scored 70%, he studied three lessons; 80%, two 



lessons; 90%, one lesson; 100%, he was assigned directly to the next 
pretest, covering four more-advanied lessons. In this way, -the 
learner was not practicing skills he had already mastered, but was 
given an opportunity to master in small steps if lie needed the 
^practice. After he had taken the second test under any objective, 
excessive error would cause the terminal to prescribe a return to 
prior lessons. Since the /aide "and teacher also received this mes- 
sage, they were able to work more closely with the student to de- 
termine the cause for crror^ and possibly correct it. 

When a learner had taken the last test for an objective, he 
would be recycled through some prior materials or assigned the 
first test on the next objective from which he received his off- 
line prescription on the basis of his performance . 

This- -linear model moved the learner in small steps, provided 
for-more likely success , allowed repetition as needed, and was 
individualized by performance. The. learner worked on his own 
paper-and-poncil instruction? T packets, which were numbered by 
objective and le^^on -sequence. ^' 

Format of Lessons . The programmed lessons were first devised 
in a somewhat traditional programmed format, with multiple choice 
questions presented on the right hand side of the page, and a:nswers 
covered, on the left hand side, by a half-sheet of contrasting 

color. (See -Appendix A for a sample.) 1 The student circled the 

7.. , 

chosen alternative, lifted the half-sheet covering the feedback, 
and checked his accuracy. Individuals who answered by copying from 



the feedback were assumed to perforin, poorly on the computerized 
assessments, and would be recycled under the teacher's attention. 
This format was ...chosen for several reasons. It was felt that the 
usual programmed format of turning a page to obtain feedback would 
be too taxing for the memory of EMR students. Placing the covered 

correct response on the left made it possible to compile the book- 

\ v. ' .. ; : ■ ■ • 

let with .staples on the left side which is the standard book format 

whereas 3' top binding would not have been* . 

Several problems 'were seen jwith this format,, but it was adopted 

i 

as the best, solution until time allowed a further search of possi- 
bilities. Although the format provided immediate feedback, it 

- i 

%^as undesireable for several, reasons . ' (1) Storage is a problem 

wnen one side is twice as thick as the other, (2) All answers on 

a page could be seen when the half-sheet was lifted, rather than 

just one. (3) The student , recorded his answer on the right half 

of the page and then went to the left half td check his response, 

whichtds contrary to the left-right sequence used in the reading" 




By Spring a new format was developed which eliminated the pro- 
blems of the first format and in^H^irtien^Xl) provided special 
feedback to redirect the thinking which may have causecPsr-studcnt 
to mark an incorrect response, (2) eliminated any possibility of 
"cheating", and (3) maintained student interest. FoTeaeh alter- 
native there was a response box containing a latent image which 
would only appear after beiag marked through with a latent image , 
pen. (See Appendix B for a sample.) In addition to being a much 
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more dcsireable format from the • learners point-of-view, it was 
also found that this format greatly simplified production of 
.booklets by eliminating th_c_ -time-consuming collation of alter- 
nating fullrsizc and half-size sheets of paper. 

Pretest. A. pretest' for the total s$t of objectives was de- 
veloped to determine which objectives in the sequence each stu- 
dent had already' mastered^. This test was also ^ised as' a Post- 
test. The test is in paper and pencil form and is composed of 
two items from each objective. (Sec Appendix C for the Test,} 
Each student was required to start instruction at a level in the 
sequence no higher .than where he first-missed an iteir, Discussibn 
of pretest and posttest data appears in Section IV. 

Reliability of On-line Lessons . Table 2 shows the" character- 
istics for each on-line lesson, all of which were considered 
tests. In examining the coefficients of reliability it 5»s im- 
parativc that consideration be £iv,en to the influence of sample 

\ 

size test length, difficulty level and variability of scores on 
.the reliability statistic Maximum coefficients} of reliability 
are most lii:cjy for tests with mari>; items wftere the average item 
is passed by of "the subjects, arid 'total^ scores vary a lot,, It 
is not unusual to have thousands of subj ccts* involved" in such anal- 
yses. These factors suggest that -cocf ficicnts of reliability ob- 
tained for unit tests in this project are very rough estimates. 

According to Table 2 only one test had an average difficulty in 
the 4.0 to 6:0 range. Thi. fcest, lesson No. 321 had" reliability of 

.705 which is very respectable considering ^hat only 15 Subjects < 

Q .e, involved. Of the seven tests with means in the range of * 



I 



f 
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<6.00 - 7.00 only one is highly questionable, test 806. In general 
• the rest of the data is of questionable value in examining relia- 
bility, but could be valuable for -visual examination of i 
themselves. 




Table 2. Characteristics of On-line Lessons 



LESSON 

101 
106 
111 
116 
121 
126 

201 
206 
211" 
216 

• 221 

• 226 -x 

*31 
236 

301 
306 
313 
316' 
321 
.326 
331 

\. 401 
406 • 
411 * 

• 416 
421 

501 
506 

•ERIC 



■ - 

N ' 


MEAN . 


SDEV. 


ALPHA 


13 


9.69 * 


.82 


.663 . 


13 


9.54 ' 


.75 - 


. 281 . 


13 


9.69 


.72 


.530 


12 


9.75 


' .83 


.741 


1 z 


zf ■ OJ 


. 37 


-.111 


12 


9.92 


.27 


.000 


13 


9.23 


1.37 


.703 


13 


1:11 


2.01 


.657 


r 13 


9.31 


.91 


. 286 . 


1 O 


8.92 


1.44 


.635 ' 


13 


9.54 


.84 


.444 


13 


* 7.38 


1.21 


- . 054 


13 


8.62 


1.33 


.541 


12 


8.69 


1.14 


. 265 


15 


8.07 


1.73 


.577 


IS 


7.60 


1.89 -~ 


— 575 




8 . 07 


1 si 
i.Ui 


.495 


15 


8.20 


1.56.' 


.545 


15 


5.80 


2.40 


.705~ 


15 


6.80 


2.17 


.692 


15 


'6.67 f 


1.81 


.490 


14 , 


8.79 


2.54 — 


.940 


14 


8 , 50 


. j.4.5 


' .479 


14 


— 18.93 


- 1.49 


.667 


14 


8.64 


2.06 


.826 


14 . • 


6 .93 


' " 2.91 


.881 


. 14 ' 


9'. 00 


- 1.25 


.534 


14 


9.00 


1.00 


.159 


14 . . 


. 9.29 


.96 


.370 



Table '2. (cont'd) 



601 
606 

801 
806 

901 
906 
911 
916 

« 921 



15 
15 

13 
13 

14 
14 
11 
11 
11 
13 



6.60 
8.60 

9.15' 
6.85 

7.36 
8.36- 
6.91 
.^64 
7/. 7 3 




1,82 
2.09 

1.29 
1.02 

2.38 
2.19 
2.81 
1.49 
1-71 



2.19 
1,45 



29 * 
•13" 
73 
89 
18 
56 
1.72 
1.43 
1.41 
1.15 
1.62 
1.19 
.97 
1.45 
1.05' 
1.42 
.62 
. .83 

.40 
.57 
.40 



.99 
-1.30 
.97 
1.16 

1.99 
2.50 



.559 
.833 

.654 
-.175 

.761 
.815 
.823 
.313 
v 565. 

.827 
.672 
.520 , 
.489 
.613 
.605 
.761 
.879 
.697 
—.-492 
.597 
.393 
.522 
.318 
.195 
.449 
.391 
.556 
-.052 
- .016 

-.185 
.300 
-.124 

.247 
.376 
.167 
' .298 

.654 
.727 
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SECTION IV. EVALUATION OP PROJEC T OBJECTIVE 2 4 

As stated in the proposal the second project objective for this 
year was "to ' cvaluate__thc efficacy of CM I reading materials developed 
during the yeai . M The-efficacy of the materials have- been evaluated 
from several aspects. -* 

Pretest Analysis . The /pretest data was examined in terms of 
validating the sequence of objectives and in terms of usability as/ 
a diagnostic placement instrument. Table 3 shows the percent of 
students passing each item, the average percent passing the two 

■3 ..." 

items for each objective, and the percent of students passing both 
items of each objective, « 

From these data it was noted that objectives 500 and 700 yielded 
very similar results. Since both objectives dealt with visual match- 
ing, and only diff erred in terms of the content being a phrase, or a 
sentence, it was decided to eliminate objective 700 entirely. Based 
on these data the sequence of objectives by difficulty would need to 
■be revise^ so that all visual matching objectives came first, then 
400 and 300 in the order, followed by the comprehension type objec- it 
tives . 

This test was used to make an initial assignment of students, 
each student assigned the objective in the sequence where he first^ 
failed an item or an objective lower in. the sequence. "Since re- 
vision and production of materials .was incomplete wlven students 
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Table 


t 

3. Pretest 


f 

Data 


i 

_ 


Item Percent 
Number Passing 


Item 


Average 


Obj cctive 
Number 


Percent 

Passing Objective 


1 


98 




99. 


0 .. 


100 


98.0 


2 

' 3 ' 


100 
100 




94. 


5 ■ 


200 


90.2 ~ 


4 
5 


89 
93 




85. 


0 


: 300 


74.5 


6 
7 


77 
95 




90. 


5 


400 


84.3 


8 

. 9 


86 
95 




95. 


5 


500 


92.1 


10 
11 


96 

,-82— r 


■ V 


* 

84. 


0 


600 


78.4 


12 
13 


8.6. 
95 




95 


5 


700 


94'. 1 


-■ 14 
15 


96 
84 




80 


5 


800 


72.5 


16 ' 
17 


77 
75 




75 


0 


.900 


68.6 


18 
19 


75 
72 




! 59.0 


1000 


39.2 


20 
21 


46 
67 




66 


.0 


1100 


58.8 


22 i 
23 


65 
51 




46 


.5 


1200 


_ : 31 - 4 
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...... 2S,A 


42 

- 42 . 




38 


•5 


1300 


27.4 


26 • 
27 


35 

1 33 




34 


.0 


1400 


1] . R 


<-\ o 

29 


35 
44 




38 


.5 


1500 


21.5 


30 


3% 
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first started using the materials many students were placed lower 
in the sequence than indicated by their pretest performance / 



Table 4. Assignment of Materials Based on Pretest 





Theoretical 






Student 


Assignment 




Re-assi pmi 


--vr-1-02 


i 7 n n 

1300 


i nnn 

1UUU 


_ j none' 


104 


14UU 


i nnn 

1UUU 


none 


106 


1000 


i nnn 
1 UUU 




108 - ; 


1000 


i nnn 
1 UUU 


J 1U1 


110 


■■■■■'71 nn w~ ■ ■ » 
~ 4UU t 


•*nri * 


none 


* 113 


£.nn 
6UU 


Ann 

DU U 


none 


114 


1 onn , 


i nnn 

JLU.UU 


none 


115^ 


200 


i nn 0 
1 uu 


1000* 


201 


n r\n 

900 . 


onn 
y uu 


none 


203 


1 OUU 


, 1 nnn 

1 UUU 


none 


207 i 


i o n n 
1 zUU 


i nnn 

1 UUU 


none 


208 


-1000 


i nnn 

1 UUU 


J 1U1 1 


209 - 


200 


onn 

ZUU 




210 


° 1UUU 


•j nnn 

X UUU 


none 


211 


o nn 

. . oUU 


OUU 




212 ■ 


1000 


i nnn 
1UUU 


■ none 


213 


800 


800 


100* 


>301 


100 


100 


100** 


302 


200 


100 


none 


303 


200 


100 


100** 


304 


300 


100 


100** 


306. 


800 


. 200 


•• none 


505 


200 


100 


none 


310 


200 


100 


none 


311, 


200 


100 


none 


312 


600 


200 


none 


- 313 


1000 


1000 


none 


3J4 


300 


100 . 


none 


315 


1500 


, 1000 


none 


3*1-6- 


200 


.100 


none 


317 


1400 


1000 


none 


318 


1000 


1000 


none 


401 


' 1300 - 


1000 


none 
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402 1200 ^ 1000 none 

406 : 300 100 none 

407 1300 1000 none 
411 ■ 1,400 1000 none 
4.17 1000 . ; 1000 _ 300* 

418 - 1300 - 1000 600* 

419 1000 1000 500* 



*Data used in this report is based on. work after re-assignment. 
, Data used in this report, is based on work prior to re- assignment. 

Of the 40 students included in the final analysis , five (5) were 
considered to be inappropriately placed on the basis of the pre- 
t^st. Based on teacher recoinmeridat ions ] and performance in the 
classroom, it was decided to reassign these students. Four of 
the five students were re-assigned to lower-level . objectives , The 
other student was re-assigned to a high-level objective. On the 
.pretest, this student missed one item for objective 200, one for 
objective 600, one for objective 1300,. one for objective 1400 and 
both items for objective 1500, 

Three students were unabie to progress, beyond objective 200, 
Although their, original, assignment had be^n adequate, these stu- 
dent vvL-iC re-assigned lu the ^ajntj objectives in order to allow 
the teacher to use the off-line materials in a new way. Only 
the original work was considered in analysis of on-line test 
per^.^ym.i^ce . ■"'■"■'.* 

Description of Students . ■* As soon as possible after develop- 
ment, all students in each EMR classroom were administered the 
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the pretest. The six students with perfect scores were eliminated 
v front further analysis at that time. After psychological services 
were received and recent I.Q. information had been obtained on 



each student, 


eight additional 


students 


v: ere e 1* imi n at e d : 


At- 


trition of the other four students occurred due to lack 


of post- 


test data or 


moving. Table 5 


shows .the 


attrition of students by 


EMR teacher. 












Table 5. Attrition of , 


Students . — 








Eliminated' Due to 


Number 




Total No. 


Perfect 


not other 


in final 




of Students 


Pretest 


EMR Reasons 


Analysis 


— y ■ 

Teacher A 


14 


2 


3 1 


8 


Teacher B 


12 


1 


1 1 


9 


Teacher C 


18 


0 


2 . 1 


15 


Teacher D 


14 


3 . 


2 1 


8 













Tatsrts^ l ; 58 6.8 4 40 



Characteristics of the 40 students included in the filial analysis 
are 'shov/n in Tabic f . . 





Table 


6. 


Student Characteristics, of 


those in 








Final Analysis 








Rsce 


Sex 


wise 


.Full Scale ' 


Teacher 


B 


W 


M F 


Ranp,e 


Mean 


A 


7 


] 


2 • 6 


62-74 


67 ' 


B 


5 


■*4 


5 4 


61-77 


71 


C 


9 


6 


8 7 r 


59-77 


70 


D 


6 


2 


6 2 


50-72 


65 


;To-t3L__ 


27 


13 


21 19 


50-77 


69 
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- * * * 

"In* Figure 2, the number of on-lineJ^§t.s completed by each 
student is shown. The. .first 'test for each objective is labeled 
across the top of- the figure. Each "X u represents an on-line 
test completed. As can be seen there was a lot of variation in 
the amount of the materials completed except for those students 
-starting with Objective 1000. This was probably due to the 
facL that most of these students were waiting tor Objective 1400 * 
to be produced in the revised format. With the limited time re- 
maining in the school year, variation in individual rate was not 
as noticeable. This figure does not show the total amount of 
work completed, sinc e aflx ir jeach on-line test a student could be 
assigned anywhere From no off-line lessons to four off-line 
lessons depending upon test performance. In some cases a stu- 
dent would be assigned to previous off-line lessons and then 
would retake the on-line test. 

Table 7 shows a summary of number of units completed. Although 
some variability in mCcui number of units completed is evidenced, 
t,hp m^fH an number ot units completed was very consistent between 
teachers of different students. However, the greatest range of 
variability occurred among the students of Teacher C. Whether 
this was due to'the larger number of students or to teacher pro- 
cedures in the classroom is unknown. 
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Table 7. , Number of Units Completed 



Teacher A Teacher B Teacher C Teacher I) 
Number of Students (8) (9) (T4) (8) <■ 

Mean 28.9 28.2 24.0 32.0 

Median 30.-5- 30.25 29.5 30.4 

Range 14 11 39 10 



Classroom Procedures . All students were administered the pretest 

prior to working in the materials. Each student was then assigned 

r - - 

to an objective as shown previously in Table 4, page. 23. Each student 
started with the first test for the assigned objective^ The test was 
taken at the teletype machine, except during the few weeks prior to 
complete installation of the computer hookup. 

On the. basis of test performance the student was assigned 4 3 3, 
2, or 1 bff-llne programmed lesson for test performance of 60% or less, 
70%, 80%*, and. 90% respectively. If test performance was perfect, the 
student was assigned to the next test. Each student was to progress 
at his' own rate, completing any number_Qf_le^sDiis y each day. Teachers 
(or aides) were to read instructions to the student und explain the 
example gTveri" at the beginning of each lesson. The student war^'^o 
complete each page before looking under the blue half-stieet to check 
his answers. After completing the page, the student was- instructed to 
lift the blue sheet and check his answers. If he fouTjd any errors/ he 
was to circle the correct response. Teachers were asked to praise the 
student for working without copying, even if errors were madp. For 
further details see Appendix D, Instructions Eor : Use of Booklets. 



The tel etypQ- terminals were available in the classroom from 
8:30-2:00 p.m each school day except on Tuesdays they were not 
available between 11 : 30 a.m. and 1:00 p.m. JEach teacher arranged her 
own classroom schedule within ,the general restrictions. Appendix E 
.fives more details regaring initial" procedures . 

The large segment of time during which the computer program 
was available to students - compensated somewhat for the great incon- 
venience due to telephone line Tai lures. Appendix F si low a the actual 
-downtime- for the computer, 15 days, and the time of telephone line 

failure--17 school days of- initial delay, one month of telephone line 
f failure for all four terminals plis an additional two weeks of 
> failure for one- of the terminals. 

Ual^^^iLthe^timeLtTie revised format for programmed booklets* was 

available, it was evident that students needed more repetition than 
.was being provided by the branching techniques which had been used. 
Thus, procedures used with Objective 1400 materials required that each 
student -use all the materials . Thi-s^£o.r t mat required the student to 
wark a space for the selected response with a special pen which would 
then prnos^e a latent i™?g^ -F??h student was to; read the material in. 
a dotted box, read all possible answers,- then" mark/ the answer he 
thought was correct. If the selected answer .was incorrect, the student 
was to read .the^latent- image message and then select between the 
other alternatives. Detailed instructions were prepared explaining 
these procedures and how to teach the students to use the materials 
appropriately. (See Appendix G , Procedures for Revised Programmed 
Format.) ' 



Questionnaire information from the teachers indicated that 
the teacher aides managed the use of the booklets and the teletype 
terminal, finding the appropriate- bookJet and reading instructions 
to the student. If a student did not recognize a picture, the aide 
told the student what the picture represented. Students worked 
approximately five minutes a day with the materials, however, some 
students sf?ent"%ore time each day due to their interest in the 
materials. Approximately 5-10 lessons were completed each week* 
(See Appendix H, Questionnaire for Wakulla Reading Project.) 
, — - Po s 1 1 e s t P er f o rman ce . A t-test was performed on the gain 
scores from the pretest to the' posttest to determine whether there 
was .any significant improvement in performance. The mean gain of 
2.025 points was significantly different from no gain at the.. 005 
level of significance' (t=3.33 with n=40) . 

Performance of students within each classroom was then examined. 
Table 8 shows the means and standard deviations for each -group of - 



students . 


There was^sigi 


iiificant 


gain in two 


of the four classrooms. 




Table 8. 


Mean Gain Scores on 


Posttest 


Classroom 


n 




Mean 


Standard Deviation 


A 

.■: B ' 
C 

D • 


- • 8 
9 

■ 15 
8 




1 . 00 
1.78* 
4.27** 
-.88 ', 


2.26 
• . 2.16 

4.20 ' 
3.52 


* p <.025 


** p <L 


.005 ' 


— i 





•An attempt was made to verify any differences between classroom by 
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a one-way analysis of covariance, using pretest scores as the . 
covariate. There was a no significant difference among the classroom 
after adjustment . wa&jnnde with the covariates_j[F= .964, 'with 3,35 df). 

Examination of the gain scores showed that 35% of the 40 students 
did not improve on the posttest. Six of these fourteen students were 
in classroom D. , 

Although the group of students as a whole showed significant 
improvement, Lhoro wn-s a ^rual deal of variability, and some .children 
did not benefit from the programmed materials. Since these materials 
were intended to be supplemental, t& regular classroom instruction 
and- were- intended for EMR students, the results indicate* that changes 
are needed both in the materials and in the procedures. * 

Recommendations for Improvement of -the Materials . Based on the 
students f performance and feedback from. the teachers, two recommendations 
are made in regard to the procedures. (1) Materials for any particular 
, s objective should only be u^ed at the time the teacher is v/orking with 
the student on that objective. During' this developmental year, students 
continued to work through the materials in sequence regardless of what 
was happening during regular instruction. _ f 2 J The students needed a 
great deal more repetition than was provided oviginally and thus the 
branching techniques should be eliminated, ^Any student r not— being ^abl 9 
to perform the objective should work through all materials. 

This latter change in procedures indicates, a need 'to revise the 
pretesting procedures. Rather than testing each student on all objectives 
it is recommended that the student we given a longer testy preferably < 
with at least five, items, on each objective as deemed necessary by the 
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classroom teacher. This would eliminate the problems of reassign- 
ment, of students and would utilize the general information about 
student capabilities which teachers obtain during day-today operations. 

The materials themselves need to be greatly expanded. The 
original materials were almost entirely in the area of comprehension, 
and it was found that many of these students needed to acquire the 
basic word-attack skills. Table 9 shows the minimum recommendations 
for expansion of the materials. Objectives from this year should be 
placed in a new sequence and additional objectives should be added. 
With these further developmental changes, it is felt that the materials 
could be useful to teachers and could be effective in teaching EMR 
students to read. 




c 



■3 









P 








fn 




O 




O 




P: 




*+H 




•H 








P 




a 




a- 








c> 




i — i 








Cj 








P 


r< 


rn 




o 


o 


p 




£■ 
P, 


1/5 






O 


C 






rH 


o 


cd 




O 


>rH 


P 




> 










• H 


a 






> 








O 


Ph 






lo 




nui 




o 


o 






> 


p 


p : 




C) 


o 






a 




■ ^ 



cd 

• H 
fn 

P 

cd 

:£ 

O 

P 

O 
'•H 
P 

cd 

N 
•H 
P 

P 

o 

<D 
C/l 
O 

o 
u 

Ph 



P 

O 

m 

o 



P 

s 
g 
p, 
o 

o 

> 

o 
-J 

E 
P 

.e 

P 



X 

m 

-H 









P 


















P 






0 


rH 










0) 






t0 


CJ 
















cd 


P 










•H 






rc 












+\ 






CJ 


i-H 










fn 






Ph 












0- 


fn 




Ph 


CJ 


6 








P 


<D 




p 


6 


U 








P 


P 






cd 


o 








0) 


P 




p 


to 


Mh 








H 


le 




o 


X 


p 








0 






CD 


Mh 


0 










0 




LI 


•H 


r* 








cd 


to 




cd 


P 


P 








o 


cd 




o 


P 


O 


i-H 




CN 


rH 


u 


to 


P 


CJ 










0) 


fn 




CJ 


-a 


P 










<D. 


CD 




•H 


•H 


> 




> 


-o 




> 


o 






•H 




•H 


i-H 


o 


•H 


i— H 




"d 


P 




P 






P 




rH 


CJ 


O 




O 


P 




O 


p 


CJ 


P 


0 


0 


0) 


0 


0 


<D 


CJ 


P 


P 


' r-j 




•t—i 


> 




•r-» 


> 


P 


•H 




3 


*a 


•H 






•H 


CJ 


fn 


O 




O 




to 


O 


o 


i-H 


Pm 



o 
P 
o 



X 

cd 
o 

<4H fn 

O rH 

cd 

p 

O 

•H fn 
P O 

cd :< 
p 

rQ P 

6 cd 
o 

O LO 

cd cj 
> 

•H P 
O 

CO CJ 

•H «n 
E- O 



34, 



O 

u 
o 
cm 

p 

o 

•H . 
P> 

cd 

fH 

cd 

Ph 
CJ 

M • 

P O 
•H > 

•H 
CJ. 4-> 
P O 

o o 

nj -rv 



10 






i-H 






cd 






•H 














P 




P 


a . • 










52: 


J -H CJ 
4-> 




4h 


^ 4-> 


§ 


O 


fn CJ 


cd 




0 rH 


cH 


P 




DO 


O 


4-> OJ 


o 


•H 


OJ 10 


u 


P 


r-H 7i 


Ph 


cd 


o 




M 




CN 


•H 


.10 o 


i 1 


P 


cd P» 






••op. 




w: 


rH fH P 


/S 


Or 


. CJ 
0 Ph CJ 


t 




• >- & § 

v «H P cd x 






0 






rc 


i 




CM 


c>-b X 


■p 




•r-y > 4H 


• o 




«H «H 


CO 


i-H 


' O U P 


; v. — ' 



B 

CO 



0 
> 

•H 

O 
0 
* i > 

o 



•H 

P 

0 

•H 



O rH 

£ o 
0 X5 ■ 

p 0 
p "p 

0 -H P 
rH 'H 

P ■ Ph 

u p- 

0 0 0 
> 

O O CO 



CN 



GO 

o 

rH 

a. 



cd 





^ JH 












o ~ 






P 0 






0 CO 






P> cd 






P rH 






0 pC 






W P, 






rH 






O 0 






P 






0 P 






CO «H 






cd ?H 






rH Ph 












Ph 0 






e 






nd cd 






0 W 






P 






p 0 




LO 


•H X 






fn P 




0 


P. 




> 


X 


0 


•H 


cd tp 


O 


P> 


•H 


P 


O 


P P 


CJ 


0_ 


„0 P 


P 


•r— » 


> 0 


P 


rQ 


«h nd 


o 


O 


U 'H 


to 



0 

•H 



0 

-co- 
ed 

rH 
P< 

0 
P> 

P 
•H 

rH 

Ph 



0 

to 
cd 

rH 
Ph 
0 



\ 

A 



u 

Ph 



CM 
i 

cd 



i1>. 




cd-X 


0 


o 


P 


P 


O 


rH ' 


o 




rH 


P 


0 


0 X 


P 


o . 


'r-i 


> Mh 


o 


CO 




•H «H 


CO 




o 


P 





0 
> 

• H 
P 

a 
0 



0 
a 
p 
0 
p> 
p 
0 
to 

0 
p> 
P 

•r*" 

u 

p. 

cd 



0 
p 
p 

•H 

'r/ 
Ph 

0 

cd 
to 

si 

\ > 



p 
o 
^ > 

• O *'rH 

CJ 



X 0 
4h a 
p 
0- 
p 
p 
a 
to 



CN . 
CT) 



to 
p 

•H 

rH 



0 



0 
o 



o 

CO 



9 

ERLC 



tO 


p 




c 


o 




o 


■r-i 




CO 


P> 




to 


•H 




o 


4-> 




rH 


O 






P-, 


• 




O 




o 


rH 


p. 








■ u 


o 


P 


o 




o 




o 


<0 




e 


p 






o 


C 


o 


u 








o 


■H 






> 


"6 


rt 


o 




G 


rH 


o 


u 


P< 




a 




rH 


c 


o 


O 




P <4H 



4h 

•H 
+J 

p 

•H 



P> 

rP 



CD 
> 

o 
o 



-d -d 

fn P 

o r 

O 



*P p 
4n 

•H 

4-> 
*» Cj 

+-> rP 

P +J 

cd 

O 

*/) -H 

p £ 
"o *d 



p 

o u 



•d 

+-> 
p 

•H O +-> 

rH P 

fn p 

P O 

-p to 

PL, O 



rH 

'd o 
, P 4h. 

_<D -H O 
> rH 



P 
TJ 
C 

to 

+J 
P 



o p p* o 

0 0 4-> to 

•n >»U p 

pD *H *H O 

O U Pi O 



P rP 

•rH £ 

C , 
O 4-1 
to CV 

p 
c 

o 




p 

o 

•H • 

,P^ r d 
c 

op 

PHrP O 

L ' +-> (0 
P 

, O. X P 

•r~, > 4H. Cd. 

^ -H 'H ^ 

O O P> P. 



*d 
o 
p 
P 

• H 

rH 



CM 



b0 
P 
•H 



CD 

o 
u 

, o 

-CO 





P 








CD 


bO 






*d 


P 


/ N 




•H 


ti 


dill 








U 






Fh • 






u 


P 


O 




o 


to p 


u 








Oh 






rH P 

r J C5 








tn 




CD 


•H CD 


1 




4-> 


-E 






P 


O 


< 




•H 

5^ 


h to 
n - 




CD 


Ph 


^» 'd 




> 




o .u 




•H 


cd 


•H O 


CD 


P 




Ph ^ 


O 


U 


P 




rH 


CD 


a 


X -P 




•i— > 


> mh nj 


o 




■H 


rP 


CO. 


O 




P P> 






C5> CD -P P> 



. j 



o 
o 
c 
0 

-P 

c 

0 
(/) 

T> 

o 

4-> 

•H 
P 



•H 

C O 
O ID ' 



o 0 

■H O l 

^ 0 
P> 
0 C 

P 0 

P> 

U +J 

-H cd 
^ ^: 

4-> 

O . 

X t/) 

p> o 
-p 
X cd 

<P p 
■H 4-J 
P> t/) 

O r-H 
"J p-H 

r-5 »H. 



P 

cd 
0 

to 
i 

CM 

cn 



to 

»H 
P 
P 

o 



o 

u 

o 
co 



G 
O 



0 
> 

»H 

P> 

' O 

0 0 
■r-> 6 

O CO 



36. 



■h c: 

cd • 



E trt 
O o 

f O > 

•H 
Cd 4 ' 
U 

w o 



•H 

H o 



P 

o 

l/J 

c 
cd 

p 
u 

r-t 
0 



P 

t/) 



CD 



0 

o 
PJ 

0 0 

P> 3 
G 

O t/i r^i 

■H Cd Cj 

P> o 

o p: o 

0 0 p 
■r-i > 

«H O 

O vLD 4-1 



0 
CJ 
P 

o 

CO 





p> 












o 








o 


p> 


P> 








-H 








•P 


IT; 








•H 


O 










PP 


■H - 






P 


o 


cd 






O 




0 






^ 










P> 










•H 


• H 


P 








<4H 


o 
















O 






to 






0 






P 


■P 








p 


C 


P 




0 




0 






.> 




e 


>S 


0 


•H 


cd 


0 


<P 


P 


P> 




-P 


•H 


«H 


O 




ci 


P 


00 


0 


c 


p> 




O 


• r-j 




t/) 


0 


Ph 




•H 


cd 




Ph 


o 


O 




o 



I 

o 

<P 
O 



P> 0 
P> 

0 cp W 

«H O 

P>*4-> P- 



o *d 



.. E 

t — l 4-J 

t — i cd 
p> 

0 t/) 
> 

•H cd 
p> 

O qj 

0 0 

•m > 

o a 



o 

^ P 

•C O 

cd ^ 



to 



cd 

w tp 0 

O O E 
P> 

•H p 

W .H p 

C cd O 



I 

< 



0 

o 
p 

o 

00 



0 - 

rC 0 

P^+J 

>t>" tA 
tp 
•H 

P 

0 

-H 



O 



CN 

«-H P 



a 
> 



to ■ 

H 

cd 

cd 0 
p> E 

o O'd 

•r-» > P 
-H O 

O W 



i 

< 



0' 
a 
P 

o 

CO 



ERIC 



o • 
P > ■ 
O »H 
•H i> 
+-> O 
cj o 

I- J «r-> 
•H X) 

c o 

cj 

DO P 
rH »H 
O 

O t/> 

h 7i 

cj »H 
K 
(/> O 

•H 

X. 4h O 

P O iH 



<4H 
O 

fn 

O 

e 



»jp 

to 

Tj p 
p-cr 

* o 

W r-H 



•37. 



10 H 



J P ^ 

'vi O .Vl- 



O 

•P Ti 

•H O P (/) 

K H +J -H 

t-h cj 

rH ' 

>S »H S ^ 

H ri U U 

p- > cj 

p CO r-i 

0 CTj O O 



rH 



E +-> 

Cj -H 

rH 



rH 

o 



•p 

vP Co 

H E 



G) [/} O 



-P 



U 

o 



U 

o 



o 
in p 

Cj P 
-rH O 

Ph 

o x 
-p -p 

. rH ^-J 

Ph U 

e o 

O f-H 

G O 



cj 
rH 

-C 

o ' 

to 1—1 

- O i-i 
+J p 

GO t+H 

& e. 

T-J 

O cj 
go 



CO 

> 

•H 
+J 

o 



p 



<-0 



O 
•H 



P 

p 0) 
00 O -P 
•r-» > P 
^ »H O 

O O tfi 



o 
u 
p 
o 
•p 
p 

GO 
</) 

•p 
o 

rH 
-Ph' 

6 
o- 
u 
p 



X r 
o to 



> 



p 
ri 

o p 
o a> 

O U 



ao o 



p (D . 

P f 0) 
P 

.rH O 

rO O 

rH ^ 
> 

O Q> 
+J. O ■ 

-P Pur-H 

o e ih 

O O 3 



v) U tf) 
ri o Co >s 

rH 2: rH H 
^ _ ^P r-H 

4-1 



O HP 

-P o 
o o 



o to 
-p p 



> 

•H 
-P 

o 



O V) 
(/) o o 

•P E 

o 

o 



O Ph 

p E 

O O 

P ' 

o 



O O t/j o to 

> 



13 



o 

rH 



O r P 



•p 
o 

pH 

E 
o 
o 



rH P 



G X H 

•P O 2 

r-i tO 

Ph S P 
E -H 
Q 
' rH 
O 



CO 

> 

•H 
.•P 

o 



p 

CJ 

o 
E 



CO o 

cj X O 

p> p 

p 

*H O CO 

O O .-h V) 



CO 
P 
P 



CO 

> 

-P 

o 

GO' CO 
^ E 
ir Q Cj 

O 00 



CO 

o 
p 

CO 

+-> 
p 

CO 
CO 

fH 

o 



GO 

to 

Cj 
rH 
rP 
Ph 



rH rH" 



a. 
> 



rH & 

O «H 

O .rH 

CJ rH 
rH »H 
X E 

rH* *H 
O 

O »H 



O P 

O o 



•H' P 
+j o 
P +J 

o 

• H 



to 

P 
H 
P 

P CJ 

O O 





















rH 












o- 


CO 


J 










o 




o 










p 














o 


p 




4H 








-p 


CJ. 


-p 


o 








p 














o 


O 


o 


o 








10 


r-" 




CO 




/■ — % 






+3 




p 




I — i 




to 






<D 




] 






p 


P 










u 


o 


o 


cr 




< 


rH 


o 


o 


•H 


o 










, ! 




VI 






O 




o 


to 








> 






o 


rH 






•H 


CJ 






o 






-P 










to 


o 


U 


p: 


X. 




-p 


rH 


O 


o 


rH 


P3 


r-H 


P. 




•pi 


> 


o 




•rH 




o 


r Q 


■rH 




o 




s 


00 


O. 


^3 


to 


4 J 


■P 


CO 


^ — ' 



ERIC 



o 
e 

e 



o 
P 
o 



> 

•P 
O 

CD O 

o to 



O 
P 

in 

to 
•* ^ 

•P " 

o p 

O O 
> 

,£) 'H 
O U 





bO 
P 










•H 


1 






o 


P 








P 


rj 


o 


o 




CO 


O 




p 










<D 














' to 




Ph 








O 




P " " 




a 




< 


O 




p 


p 


"to 


•H 


/ — 




o 


r 


j_j 


• — i 




P 


o 




i 


o 




•H 


a 








P 


•H 




p 






rH 








r—t 


Ph 








a 




& 


o 
















o 




•H 




■y 


u 


P' 






a 




p 


P 


in 






o 


•H 


3 




. o 


M> 


<~* 


rJ 


5 


C/j 


■ H 


EH 


O 


p 





o 
> 

■H 

P 
U 
O 

O 



i— i 

•H 

6 

-H 

in 

o 

to- 

to 
•H 







iH 












to 




CD 






■P. 








to 












o 


bO 




P 




•H 




P 




to 


0 


CD 


Pi P 


o 


0 


iH 






Pi 


> 




-P 


-d 


•H ' 


>> 


to 


iH 


CD 


CD 


P 


P 


O 


O 


P 


t-t 




§* 


O 






o 


o 


o 




p 




o 


p 


p 










O 




•H 


<L>- 


<P 




«4H 




■H 


to 




rH 


P 


•H 


•H 


U 




o 


to 


p 


CD 




y 


6 






a 


CD 




to 


a 


<D 




r' 


*P 


H 


■r-i 



. * ^3 



ERIC 




SECTION V. EVALUATI ON OF PROJE CT "OB JECTIVE 1 3 

As stated in the proposal, the third objective of this year's 
activities was to "continue to explore an approach to -intellectual 
evaluation of the mentally retarded learner, utilizing the continuous 
monitoring and performance assessment capabilities o^CAI-CMI rather 
than conventional testing procedures." 

It seemed that the t-ime r 1*afccn.. to respond to each test item on 
the telotype might yield some., information regarding the intellectual 
evaluation of EMR students. Since recent scores on the WISC were 
available on all students,' these scores, latency of responding, u 
and gain scores were correlated. Table 10 shows the correlations 
of these variables. The "increase in Objectives passed" was determined 
by assuming -that an objective i\ras passed on the test if the student 
/correctly marked both items for that objectives-. The increase was 
calculated by subtracting the number of. objectives passed on the 1 
protest from the _n^b.ejc__oJLo.b_j_ec.tives passed , on the posttest. "Increase 
in raw score" was determined, by, the difference between raw score on 
pretest and posttest. Latency of responding refers to the average 
number of seconds between the time the teletype completed the typing of 
the question and the student's typing a response. Both WISC subtests 
as well as full scale I.Q.s were used in calculatingrrrcorrelations . 

The relationship between latency of responding and the increase 
in number of objectives passed was found to be significantly different 
from zero at the -025 level of significance; however, there was no 
significant relationship between latency and increase* in raw score. ... 
Latency in responding was_not correlated with any of the three, measures .. 
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of intelligence. Both performance I.Q. and Pull -Scale I.Q. did 
•correlate significantly (p<.05) with the increase in nuiaber of 
objectives passed, but not with increase in raw score. 

1-roi.i this information it seems that those students who took 
a longer time to respond to the test items tended to increase the 
number of objectives they passed on the posttcst. Perhaps these 
students need to be encouraged to respond carefully rather than 
quickly to academic tasks. 
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v 

SECTION" VI. su:>r>;.\ifY 0) ; CONClhUSI iO\_S 

The reorganization of Year 1 materials into sections according 
to behavior objectives tonded to Jii ghl j gbt the iack of word-attack 
skills in the original materials. The addition of tvo completely 
new sets of materials for objective? in this area rondo an improve- 
ment in the comprehensive nature of the materials; however, there 
are many more materials which should be developed along those lines. 
The original sequence of objectives contained some errors and the 
empirical sequence is shown in Table- 8 along with the recommendations 
fo*r expansion of the materials. 

The branching technique originally designed proved to be too 
limiting. EMIl students appear to need even more repetition and 
drill than originally thought. 

The original format of off-line programmed lessons presented 
scleral problems—moving from right to left when checking responses, 
temptation to copy rather than to think, and uneven booklets for 
storage. The revised format, which was based on the latent-image 
process developed by A,B. Dick Company, proved tc eliminate this 
prob i cm und app e^fe d t v mo l i v a t c l } ic? c uden t s . The rc was some c one cr 
expressed by teachers that without the novelty of the computer, the 
students would lose interest. This format would compensate for that 
loss. 

The pretest was found to be somewhat inaccurate in placing 
students within the sequence. A better technique would be to incrcas 
the number of items for each objective. The pretest contained only . 
two items for each objective. It would be better "to increase the 



ft 
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tin; nuniK-r of items per objective and to administer only tliat 
portion of the total tost which scored relevant to the student's 
capability. The student who caimor match letters of the alphabet 
docs not nornl to be tested in the comprehension areas of reading. 

Tlut group of 40 students for whom complete data was available 
demonstrated significant gains on the po:-ttest. Although there 
was some difference between classrooms tais was not significant. 

The materials as they presently exist need to be revised 
and expanded before an acceptable set of supplementary reading 
materials are available for the classroom teacher of EMR students. 
The needed expansion is detailed in Table 8. The area needing 
greatest expansion is v-ord-attack skills. m 



Examination of the relationship between performance on these 
materials^ and the student's latency in responding to test items 



more time in responding tended to demonstrate more gain in the 
number of objectives passed on the posttest. No significant relationship 
between latency and I.Q. measures was found. Performance and full-scale 
I.Q. vvLu correlated p^iitivcl/ with increase in number of objectives 
passed . 

Those who have worked on this project believe that the develop- 
mental efforts have been worthwhile and that the revisions suggested 
for the materials and the procedures would yield a significant 
contribution to reading instruction with EMR students. 




students who took 
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Appendix A. Sample of First Programmed Format. 



NAME 

DATE 

BEGINNING TIME 

ENDING TIME 

TEACHER OR AIOE COMMENT 



Lesson 1203 



45. 



Read the question above the dotted line. 
>'ind the -answer below -the dot ted line, and 
circle it.. 

Example: 

WHAT IS THE' OPPOSITE Or' CLOSED? 1 



0 



2. OPEN 



— 



LOSE 



1. S0f\E 



OPEN 



J 



3 . POP 



' WHAT IS THE OPPOSITE or FIND? 

. •]'. LOSE . ■ ■, 
— SHIRT " 
3. TO 



l; -ALL 2) 



WHAT IS -THE OPPOSITE OF NONE? 

1. ALL 

2. THREE 

3f SIX .• • 



WHAT I'S THE OPPOSITE OF DIRTY? 



\ 

CLEAj^l 



1 . . DOG 

2. FASTi 

: 1 

3. ' CLEAN' 



9 
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BEFORE ) 



r 



fit AR i 



{ J * HUNGRY 

y. 



c 



. AFTER 



\ 

er|c 



i 



jv'lAf IS TH! 


\ OPFCSirr. y: : after? • 




■ u 

V 

X ' ■• * 


•2; BEFORE- 


- | .' , t s 

' 0 1 


2. FIG 


— - ' V / 


WW- IS TM! 


["..OPPOSITE OF FAR? " • • 



1 . NEAR 

2. TALK 

3. •'• THE 



WHAT, IS THE OPPOSITE Of. FULL? 



drive' ■ 

F/aN \ 
HUNGRY 



WHAT IS THE, OPPOSITE. 'OF' BEFORE'? 

1. PUP- " • '• 

2, AFTER ' 

t 

' TAJ I' 



147. 



stay) 



WHAT IS THE CPPOSITf. OF GO? 



1 STAY 
?. NICE 
3. STORY 



W!'iATJI c THE JPPOSI IE OF FAR? 



NEARLY 



' push~^ 



1. cow 

2. YESTERDAY 

3 . NEAR 



WHAT IS THE -OPPOSITE 'OF PULL? 

1. HOT 

2. PUSH j- 

3. FIRST • u ~- 
^ : ; 



\ 



\ 



AS. 



Appendix B. Sample o£ Revised Programmed Format 
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Lesson 1406 



3 * ; -—^r^ .j 

\ The -Good King sat on his throne -r.nd sighed, s, Thd Brid King is '"coral ng 
.A. to take- "our gold! 11 . : , ■, 
' • 18 Father, u 'asked 'Pflnc^ss^Hi Ida, Ms ■ 'there no way to save the,., gold?" ■ 

4 . The King sighed; "lite "can .-save, it if vie give th« Bnd King sonsethi r?e 
1 ho new that nobody has ever sear it -before., :l 

1 Hilda ms silent.- Saddam y she shouted 9 u i kn/»w something nswl l< 

6 AnffTSway she ran. ^ . 

J Up code -the Bad King- "I have- cone " for the- orld," he reared 9 "Unless 

1 you' can give me something, new!" / "' * 

1 "Wait!" criad Hilda* and she ran In with a smll box. - . ... 

5 "What is this?' 1 "frowned ttfa Bad King. Insidi of the. box. was an egg- 
8 "Why .this is nothing new, 3 ' he laughed - ..But, slowly the egg bogan to crack 

" 5 and out popped a. baby chick! . ■ 
i "This chick is brand new-i" 1 cried Hlldt. 

r * "Nobody couTd possibly have aeon it before S ,J said the Good King. 
r - "You will get no oo.ld from ■« si 11 

r - V~- - - - - — * ■ ~ 

Which-iaauld haseJiappsoed iti t:ie story?- - . 

I. The Good Kim frowned vh*n Hilda Graved the wld. 



L 



<T~ ii 1 



he egg hatcjied ch 1 ejes . 



"2 . Hi 1 da fell asleep ^when .she thought of her ...idga ? 

! . , ■ „. 



If the story went on, which fiilrjhfc hrwe happened V 
2. . , Hilda an£ the food Kino hai ,a fteyebratioa. ' 



1 



?... The chick stole the foold. 



r 



5* Hilda cjot a , spgoklng.. 



-Which of these are enemies? 
1. Hilda and the chick.. • * 



. L 



2. The Good,Kinc! and the Bad King... 



v< 



4 



.50. 



' 3. Hilda and tie Good Kinq. 



F " 


L— : _~ ~ : — — 1 


This is a story, 
L A Surprise./ 


about 




r ■ . • ' " ^ • 


2. V A dangerous adventure* • . ■■ ■ ■ • 



3. "A mystery* 



. / 



The Bad Kino, m^ted tile .Good K/lng 2 $<cjo'*d i^-causs- 



2a The Good ffiffQ was frie ndl y : 



3, The Bad K;h>^ vm$_ brave. 
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Hilda thought of. something new because she wanted to 
1. Get a chick fo r a pet. ■ . 



Help t 


"»e Bad King* ; 














j 

. : 

J 

^ 1 


Save tlis gold, 










r*. 









In this sf.ory, Hilda 
?.. Leams a lesson. . ■ 

Z. Solve; a problem. 

1 . 

3- Has ""a J]todJHnra. 




i 



52. 



H&Uery. to answer the following thought problems. 



r 



On the playground, Laura always likes to p i ay q>s the 

- : ■ \- 

1. Chairs. ' -" • ' . 



2. Houses. 



-4- 



3» swings;, 
L 



-'J 



1 



Penny pas a 'hVct'fe bird for a pet She t3eps:it in ^ small 
I, Box, 



Cage. 



L 



3. Yard,. 



Den caji'-t *r : '?<jG his-bicycls liacausa it has a flat 
X. Hand! soar, 



2: Basket.. 



L. 



3. Tire. 
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\ 










IX 














- J 






-1 







i I 



( 



V 



Appendix C. Test used for Pretest and Posttest 



ioo : ■ . 54 . 



In the first two problems., read the letter above the dotted 'line. -Find 

the same, letter below the dotted lir-o and circle it (include the. n; 
jji the circle). * . 

Example;- , • 



1. O - 



GZZD 



3. I 



1. . A 

2. ■ M 

3. c 
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i « 

1. 8 

2. R 

3- D . 



wr=AEssrtr- -j^jr-ajfenar. ^w^i:**.*^": <- - 1"* 



'J 



200' 



55. 



In the next two problems; reiicl the yrord %bove the dotted line, 
the same word below the dotted line and circle it, 



Example' : 
-. r PREE 



1. .CLOUD 
. 2. ON 



srr 



1. ARE 

2. SIT 





3. OF. . 








r 


... 

• r 


(■ . ■ •■-.«.- ■ | 

MULE-." ... ■; 

. J 
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1.. WHILE 
2* • WHITE 
3'. SMILE 




30 a 



In the next,tv;o jsroblanSj read the word f^ove the dotted line. IK 
"v;or ; d clescriberr one of the pictures below the dotted Circle 
that picture, -.V , t < 



,,.56. 



■ CAT 



















































J 




















\ 


■ 


STAR 
















/* - 


























<3 








" / 















. 3, 



... ...^.^ _ .... .» V' .' * 



j ' - JsJ ' 



er|c 



i 

/ 



.400 



57. 



In trie next two •jtooM.ems, read, the letter above the" dot0o3 lir/: m~i '. 
think about- the sound, of the, letter. Look at the pictures below ' 
the dotted line- aid think of- the word that describes that' picture. 
One df- those • words vri.ll include the same sourid as the' letter.' Circle. 



the picture .described by that .word. 

* * * i 

.Example:^ 

■ 1 "j ■ B • 



J 



r. 



1. 



„ ryr\ 
'■ XJ 

3. ^^g^** 




V5^ 



'.pa 



2. 



.3. W 




JiJ' 



K 
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2.. • 



3. 




58. 



Jr\ the next two .prdblemy, road the phrase above the 'defcWd line, 
■the same phrase below the -dot bed line and » circle it t 



Exaurple ■ . 

THE FAT CAT 



1. HE BIG PIG 



2, THE FAT CAT 



3. H IE - LITTLE KITTEN* 



THE RUMENG BOY ■ 

1. THE FAST CAR . ' f 
2.. A GOOD" FRIEND ' 
3. THE RUNNING BOY 



A SMALL HAND 



i • »■» ••4t»«o^o«Of o • a « a 



1. A TALL MAN 



2 . A SMALL HAND 



3. "THE I : IARD BALL'' 



600. 
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In the next two .problems,- road the phrase above the dotted, lino; Tb: 
.phrar.e describes a picture, below the dotted line*. Circle that picture. 



Example: . 
THE Rt/f-^iXNG BOY 




3 - i> 



THE SWIMMING PISII 




THE OPEN BOOK 



». hi 



3 # e^v5? 



In the next two problem, read the ^nlenoc aliove the? dotted Un-^ /Pi- 
the cram* sentence bold''/ the dotted' line ar:c3 circle r it« ? 



/ 



■ C -AM PLAYS. BALL.- 



1. "Xiivo boys came. .- ) 

2. "SHE IS HAPPY-. 



SAM PLAYS RAIL. 



./- ■ 



/ 

/'■ 



HE RUNS PAST. 



. / 



1. • RED IS A COLORJ 



2.:- HE RUNS PAST.. 



3. ■ IT IS COLD. 



"SOME BOYS ARE TALL. 



1. THE BALL IS VERY SMALL. 



-2, ALL PISH SWIM IN WATER. 



3 SOME BOYS ARE - TALL . 



61 



' Lr&ic v noxt-"tv/o prpbl-ej.no,' Veart the sentence' above" t!v-; dotted lira. ' 
aTha s^atence describes ow-'of tha pictures bsuLcw the*, clotted line. . 
Circle that picture. - , • - 



IKK BOY IS SITTING? 



www* 



**•*•*•••»•»<> 



(if? 



2. 



1 V 



"THE BOY IS EATING. 



- 1. 



2. 



3. 





HIS HEAD IS BIG, 



1. 
2. 
3. 



A 

x 

o 



900 



62. 



In the next two problems, road the sentence and the' question abov:: U. 
dotted line.^ Find the answer below the dotted line and circle ifc. 

\ ' ' ' 

■ \ i . • i 

• • ' . 'If IE MAN CAN RUN. • . : 

. WHAT CAN THE MAM DO? ■ 



i... ..sit . 

•2. SEE. 
Q 3 . RUN ) 



THE TREE IS GREET 1 !. 
WHAT COLOR. IS" THE TREE? 



1. RED 

2. BLUE 

3. ' GREEN 



THE BOY IS NINE; 
HOW OLD IS ifflfi BOY? 



1. BIG 



2. HE 
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3- NINE 



In tha.-n&xt two problem. Head the phrase* or .sentence above the ooti -,\ 

^Line. Notice the blank space* . One of the words balow the d<jfc.tiecl 1 

will fit In the blank space. Circle that word. 



ISxanple: . 

THAT ■ DOG. 



r _ « • j 

1. • BOX i 



2. HAT 



^ 3. BAD ^ 



, v. • 

THE ., • PIG.:. 



1. RAN- 7 ■ V" ' • t. ■ f 

/ ■ v .. 



2. CO 

3. BIG 



-A 



HIS DQG.ilAN.i -. \»TSI IIBL 



1. CARRY. 

2. ALONG 

3. " BUMP 



v 'j 



1X00 ■ . ■ _ - . : 64. 

• In the next two qi^3fci"oriff,/r , eacl the sentence and tho Question fbovn t'; 
dotted 11 no, Ri.nci the answer be lev; ths' dotted line and circle it. 

" •'•/■' , -. : : . ■ . . ' ' ■ 

• the oprosnE of/girl is boy. 

• 'WHAT IS' THE OPPOSITE OP GIRL? 



1. HELLO 

2.. ^TERN OON ' ' ' 

3. 7pOY 



■J 



THE OPPOSITE OP THAT IS THIS. 
WHAT' IS THE OPPOSITE OP THAT? 
......................... . . . f^y . . . . 

1. ' CAT . , 

.2. THIS 
3> WITH, . 



THE OPPOSITE OP COUNTRY IS CITY. 
WHAT IS THE OPPOSITE OP COUNTRY? 

1. . FINGER 

2». CITY 

3. GIRL"* '-' 



6S. 



1200 



In the next .-two problems, read, the question above the dotted line* • 
Find 'ttie anchor belov; the. dotted line and circle it. ' • 



VfflAT IS HIE OPPOSITE OF, HRLLO? 



goodbye^ ' 



2. -AFTERNOON 



3. ■ SMILE 



WHAT IS THE OPPOSITE" OF SMALL? 



•1. WALK, 



2. WHEN 



3. TALL, 



WHAT IS HIE OPPOSITE OF ALL? 



1. NONE- 



7 - ' 



2. mnm 



3) y COULD 



0 
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1300 / ^ • . . ' ' 66. 

•In the next tv;o*p]fobleii«,. read Wis sentences and the question' clove t' 
dotted line. Find the answer .belov;. the dotted line and circle it, ' 

v ••• : ' \ > ' - •. 

"Example: , , .. • ' : 

'* SAM WAS PLAYING l r O0TBALL" IN THE GARDEN. THAT . v 

" MADE HIS *BBER MAD. V,H0 WAS f^IHKR 'ANGRY WHH? 



?. MOTHER 

3. THE GARDEN 



'BE CAT SCARED - THE DOG. THE DOG BEGAN TO BARK. 
WHAT SCARED THE DOG? * : 



1. THE CAT 

2. A CAR 

3. THE DOG 



' . 'THE CAR STOPPED-AT THE RED LIGHT. WHEN BE LIGHT 
. TURNED GREEN, THE CAR STARTED "AGAIN . WHAT COLOR WAS. 
THE LIGHT WHEN BE CAR STOPPED? - 

....»*e..a..e.ee...e....e.ttee.9ee*.od..««.e..e.i).u..vBef 

1. YELLOW- ' . 

, 2. ' GREEN 



3, *E0 



1,|0 °."" ■ * < ^ " . 67. 



— -- / 



In the nfixt two problems, r6aci the paragraph ' and. tfoa question sbov? ite 
dotted lino. Find the answer below the dotted- line arid circle it, 

• •• ' Exaiiiplc : • 

■ " JOB'S FAUflSR IS ALWAYS BUYING BOOKS. " . . / 

WHERE ARE ' THE BOOKS KEPT? • ' ' 



3L « ON THE BED ." . - y •■ 

2. ON KXDKSFBMB V ". '•' 



3. ON THE BREAKFAST TABIi 



THE MAN" VJITH THE BROKEN ARM GROANED" LOUDLY. HIS WIPE 
HEARD HIM GROAN. WHAT.' IS A GROAN? ' ". 



1. A PERSON 

2. A SOUND 

3. ; AW ARM 



THE CAT STARTED TO EAT THE DOG'S POOD. THE DOG BEGAN 
TO BARK. .WHAT WAS THE DOG BARKING ''AT? 

t ■ 

1. THE CAT ..' 

2. THE DOG 

c r 

J 

3. THE FOOD 



0 
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For the next • two pro bl e m s , -read the story at.'the beginning* Iffcvh- 

i*ead the question above each of the dotted lines. Find the answer 
below each of ■ the dotted lJ^Wand circle it.- 

Example: 

• ■ • * 

WHEN FALL COMES THE YEAIHER BSGI-NS-TO CHANGE. THE, DAYS 

•; ARK COOLER AMD. SHOHJWTHAM ' THEY VERS 'IN THE 'SUKMSR. .THE 

LEAVES ' STAKJ 1 TO CHANGS COLORS.. MOST OP THE LEAVES TURN, "." 

BROWN, BUI .SCvE.pF THEM BECOME RED, GRANGE, AND YiSLWk 

SOME OF THE BIRDS PLY SOUTH BEFORE VENTER' OWES. 

0 . 

WHEN DO THE LEAVES BEGIN TO CHANGE COLORS? 



1. NEVER 



2. IN -THE PALL 

3. IN THE SUMMER 



WJff-BO J THE BIRDS -PLY 450UTH? 



Tr IS WARMER IN THE SOUTH 



2. THE LEAVES ARE '.CHANGING COLOR. > 

3. THEXDA^ ARE TOO LONG IN THE NORTH. 



. • ' ' 69. 

.'JIM LIKES TO COLLECT COINS. HIS COINS CCME FROM MANY DWiflvWi' ' 
( PLACES. JJJn'S.Fj'TipXR IS AN AIKPOulE PIDjT AND TRAVELS ALL OVER 
. . s THE WORLD.- EACH TIME HE COES' BACK FROM A TRIP, HE .BltlNGS^BI 
.A mV CQlMr . . - 

* WHAT" IS JIM'S HOBBY? " " ' f 

« • ..•'"*• 

? , * • 
.. . . v . .5 t 

■ 1. HE COLLECTS STAMPS. . ' • 

v ' .. . '« : . I. ' 

•2.' ife OOLLECTS COINS. . ' •'" 

n " - ym vvr Trpo T> T * tT">tyt r.\m»n * - 3 



WHAT KIND" OF JOB DOES .JIM'S FATHER HAVE?,. 

v 

1. HE -IS AN AIRPLANE PILOT. , . 
2i HE IS A COIN COLLECTOR. 
3. HE IS A BANK ROBBER. 

<■. . . ■■ j 



h 
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Appendix D. Instructions for Use of Booklets 
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WXKuLUA COjIIVY SQICOL .BOARD 
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. \ TITLE- VI PROTECT 
' . ■ INSTRJOlIOp FOR USE OP BOOK!£TF 

■C^n::r<il Iri^t?- : ^tioJis: Thsse'vlsooklcSts .are to used by the children / ,"' 
olT^rirndi^ Each •"student should progress at his own . rate j 

■conpleting./any number of ■ booklets and tests 'each day.. Each' student / ' 
starts with a test. (Remor±>er that all lesson numbers ending in a 1/ . u 
or 6 are tests.) On the basis of his perfomonce, he is .then assigned- 
a designated £et of lessons. The, lessons to he assigned are prescribed 
by the computer. In the case of" printed test&, the assignment is shpwn 
on the .test cover, for each possible score on the test. . * ; • 

Using the Tests: During the period when we.must use printed tests, "be. ■ 
sure 'that the printed test is legible. If not, you may' need to, go over 
some of the printing- - -The student should \vork\indiyidiially on the test. 
You . should score tlie test, and record tlie number ' N of correct responses on 
the front sheet. Eased on the student's score, assign the next lesson ' 
or lessons or the next test, a - - - \ 

Usi ng th e Lesson. Booklets: . These booklets aire small programmed texts, 
.Be sure -the inf onratiorl "on the front blue sheet* is completed. We are 
requesting the beginning and ending time so that we have at. measure of 
how long it takes students to do tlie booklets* : The instructions should 
be read to the student and tlie ■ example explained. The student should 
"then, complete tlie first page without looking under the blue sheet. After 
completing the page, tlie student should raise' tlie blue sheet and cheqk his 
answers. If he has .made any errors, he should put a cireie around tlie 
correct response. Please do not let him erase any errors. .'We need to 
know where the difficulties are.^ The student then does the next two pages 
in the sane way. We had some production difficulties and you may find the - 
blue strips cover "tlie question half -of the page. If this happens, have the 
student fold back a portion of the blue strip so. *s to expose all the \vorV 

Encourage students to follow these instructions. 'If the student should 
raise^the blue sheet and copy responses, he will only hurt himself. Vlhen 
he takes a test, he will not dp well and will have- to do. the booklets again. 
You should .encourage students to take pride in doing the^work properly. 
Praise the student . for wo'rking without copying even if he makes errors. 
Make learning visible. Tell a student what he has learned to do. Be 
delighted in each small accomplishinent; 



3>TORT7^?rr- SAVE ALL MATERIALS for us to examine '.when revising materials. 



Appendix E. Mono Regarding Initial Procedure 



WILLIAM W. JiXY-KE 

. WARREN CRUM ... 
' Djst/wct IV. 

. CHAIR HAS • 

Kenneth p.onERTs ■ 

DISTRICT I 



October 6, .197 2 



J. . C, KYLE 
. b District V 

' VlCft'CHAtRMAH 

LOWELL I* A KEtv 
DlSTftfCT H 



BOEl.B\ 
Di: 



C. FOSEi 
rnir.r III 



*1 *L O R A If D.. 1 U M - «. ; ■ " 

TO: - . Title VIg Personnel , ' . p) - 

.FROM :; v , /Elinor Elfner", Direc tor , Title VI 
SUBJECT': * Meeting/ October 4/ 197.2 



I^felt" "our meeiting was quite helpful. 1 Although we aren't so. 
formal , as to have minutes recorded, I would' lik'e to' relay,- to 
you some .decisions I felt were - agreed -upon/. If my" recall is; 
inaccurate or -incomplete please let me know. 



She should 



Dele is ion's • r egarding • pro c edus.es 



Naomi 'will coordin? tG' all visits to /classrooms . 
b e called be tween \9 : 00 .a . irk. and 1 p •m.. prior to visZting 
EMR i classrooms-; 0 v „ ' . . *r< 



the 



Ij?" thcr e ;; 'ar e any problems with oper atio,n> ; o f >' the terminals 
alrid* a phone call; needs' to be made / Edna. Reynolds should* -be" 
contacted. i ~ \ '. 

' ' : ' • ' „- ;'• ..: , - ' ... ; " # . * •': .• ' = ■' ; < r . . . / ... 

1 he_ i.ejciainai : %_.will be in operation on October- 16th. They 
ill be available for use during the following .hour.s': : 



8-; 3 Q. a > m . - 2 ToB * p .. m 



e : 3 0- a . m . - 1-1 : 3 0 a -1 m . 
and 1 ; 00-2): 00 



. Monday Jpdne sd ay s , 
Thursdays, Fridays ? 

Tuesdays ' ■ ■■ ., 



D o c is xo n 3 rei: a r cj 3. n 



"Gcttinc; Started' 1 



,x 



All teachers v.ill send a list of students) proAbn t.l y" j n 
their ciiasscs to Naomi for "del ivory ' to Edna Reynolds. 
*. 

j . 

Vho C A I staff w ill prepare a Pr.et.est contai-mrncA ;v:o i u--:.; •.. 
i o r e a c ii o b j c c t i v c . T h e s c .w ill b cr>~& -e at to K a o in i f o r: 
distribution to teachers in time for they to adm\i nin tor 
the. test*- on October 11 uh ^nd 12th, ] 



CAI personnel will .estimate, -the a± propr iate objective at 
which instruction will begin for each s-wdent. \ 

/ . \ ' \ 

A CAI.. staff member will visit each school to revie^* sicjiv-on 

p r o c c d u res d u r- i n g t h e v c o )* of Oc to^or c * r 1 ^ r 



/ a 

Dgje i s .j on s re ga rd i ng d o ve lo o me n t o f in a t e/r i a 1 s 

< ^ • ' . • . • • ■;•/.• 

The CAI staff will send to -iNaomi for distribution tol teachers 
copies of the objectives. ^"ElrlY^teachcr will ..xx-xieiveL.tyx> , -W/ij 
copies, one of which is to be returned' to CAI with comments 
and suggestions. * * ■ 1 



'For each objective there will be as many lessons as sjeem 
■necessary. The children will 4° four/ lessons in booklet 
form and then will take a test .^n the computer. The child 
will then, either repeat some booklet lessons , go to the 
next- booklet lesson', or go to the next test on the computer, 
defpending upon his test performance, j 1 

• ' ■ . ! • 

The elementary teachers of EMR units ; y will meet with Elttnor 
at Shadeville the morning of October; 13th to outline sbme 
content areas they will be covering. This inTormation will 
be .sent, to CAI so the materials can be more relevant. 



\ 



When instruction begins, there will; 1 be booklets available 
at t lit: iQv/eut level and at an i pfprrn^diate 'level . r nv>p. 



n ?. t " ^ i s I s Vi* ill 



be' develcoed 



rapid 1 v as 



sts ible 



Elinor will meet with Jeanne Ryan (October 11th) -and convey, 
information regarding textbooks to CAI personnel. 

All booklets and on-line tests are in the -developmental 
stage. The teachers are to make suggestions for- revisions 
to CAI personnel. ^ . 



u 11 

cc Mr . Payne; 



Appendix F. Memo Regarding Computer How-time and Telephone 
Line Failure, 



lb. J I 



o it. 1 -' i 
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Ccnlcr for Computer Assisted Instruction 
J - Tu)!v 13'uiSdjnj; 



y May VI 973 



" Mrs.- Elinor Elf ne.r ' " ; 
/- Box 98 - ' ' , 
' Crawfordville,' Florida* -32327 



Dear .Mrs . El fner: 



' Fol 1 ov;:i4ig "i s .the .information you requested concerning the periods- 
of time. computer, service was not available to V/akul la County. . Included 
is telephone.:! ine fai^l ure time, and computer down time. 

: Telephon e Line Failures ... , 



. October 9.,- 1972 . • Requesj: pde; for Multidrop line, 
- November lv 197 



1972 Expected completion date. 
November 28, 1972 Mjil titlrof/li tie. installation complete. 
February 15, 1973 Tel ephop^e circuit out,/ 

March 16, 1973 Telephone circuit repaired.. . r • . 

March 31, 1973 (approx. date) Telephone circuit, repaired for 4th -line 



Computer Down Time 



' January 8 - 12, 1973 

January 15 - 17, 1973 
• • February 16i 1973 • 
/ April 9, 1973V 

*~ April 19 .- .20, 1973 

... ' - ; ApriT. 23 . ^25, T973 - v 

: Yours truly , ; 

' • , i I I •■• 

Duncan N . Hansen . 



J 
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Appendix G. Procedures for Revisedt^Programmcd Format 
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pkoc r: n i 1 R ! ; : b v o r< v r o c; r: am \ i u boo i; £, ft T s 



Ci V:l\ I> A Ti I h T F OI'MAT JO: 



f l' h e s o p r u ci r a mm e d m a t e r i a l-fir/ar e u d o s i g n e d to' T cr'i v e /the stu d c n t 
immediate f ec-ibc ch . There i-fe ' a latent 'imago in^tho^o:-: below . 



Tl{o ^student' selects the answer he thin] 



e a e h po s s iblc a n v e 1; . 

i<-. corrocL and then mnjtrUs through ' he ✓ box just below that 
answer with the latent^ ira'acjo pen. If 



a 11 s r 1 s c o 1; r e c t 



five stars and a . posi t ive ' comment of praise will -appear •■ I 
t h o a n s v.* c r i s n o t e o/r ir e c t ■, t h e in e r: s a g £ will act/ a s a p r i v a t e 
tutor to 'guide the Student's thinking. 

If your stud.Zts" are' going to learn as they use these 
'materials, it is/necessary that certain^conditions be met. 

1 . Each st u d e, n t m u s t r e a d t h_e mate r, i a 1 i n t h e ■ - d o 1 1 e d 

box carcVfully- . f. ■ ' 

2 . 2 a c h student mu-s-L--~ r"e~a 3 ~ "a>l 1 t h e : a n s w e r s « b e f or*e selecting 

tJxe~--e-n-G^ he ^th in ks i s corrsct, ; ■ 

3. If the *first. answer marked is not correct, the student 
must re'ad the latent image message and the remaining 
two al natives before marking a second- ctoice . \ 



~ v. 



As- the student's teacher, it is your responsibility to 
•see that -these conditions are met- Here ar.e some suggestions 
to assist you in assuming this r e'spons ibil i 4 ty » • ' * • 

1 : Befor,e the student uses the lesson booklet 3 , make' sure 
he^ is able to mark the sheet: properly. Use the exact wording 
in the "Directions for Marking Booklets." 

2. While v the student is using the* first booklet, watch 
.to see that' he is meeting the three conditions listed above. 
^Provide . a ny ^ecess.arv instructions to be sure' that the three 
conditions^ a r e it e i n g &\ e t . Check the stu d r e nt p e r i b d .i r * 1 1 y * +■ n 
be sure he' continues to meet the conditions.. ■ • 



ERLC 



1. After the student has completed a lesson, look at. 
his responses. If three or more questions have two alternatives 
rnr* r.ked , . go over the lesson with'the student. Use an unmarked 
booklet. Have the student read the material in rhe dotted box 
to - you. . Then have the student raad all the alternatives and 
tell you which is correct. 



4'. When you look at the student'?; boottet, watch fo 
marks at the beginning .of the boxes. The student may be 
these little dots to see 5 r the stars are there. This, be 



r stray, 
making 
havior „ 



god becau. 4 .. the student .will not' learn to 
what he reads by : his method. Learning to interpret 
weaning is more important than marking thfc" correct answer. 



must be. discou? 
comprehend 
the 1 



A • 



1 
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rJIKBCTIOMS for ^/;jiK.in^ ' \^ . '/ 

T H e t g a c: h g r s h o u J d d i :• ' .■ • • 1 ; C 1 ;■; S a r 5 . ix\o P a q e a n d & 1 a t e ri t 



image n e n t c e :j o > 1 st u a : 
& h a ' f y s h ©' u 1 d s a y , ' 



will be o.siihVtho booklets. Thou 



"PUT. YOUR. FINGER on THD DOTTED.-XOX 



The teacher then check/* to _ ss:j that each studentXha's- his f inger 
on the correct bo;:. . '■ /\ . 



- ."NOW, READ ' WHAT IT SAV* 1 ■< ■: ^ l; D ;> TUE DOTTED EOX. J \ 

■ "■ ■ ' " \ ' : 

The- -.teacher pauses unci;!, .ail students -have finished reading 
the context within the- dotttf'i box. , ■ \ 

} ■ .. . - J *. ■ ■ \ ; 

u WHAT DOES IT T K L.i r -TO "DO FIRST, (name Of a 'stncle^U?'! 

The teacher calls on a student-, .who sfVould respond that you \^ 
road what is in the dotted "box f i:-.\st. If the .student does not^ 
r e sip o n d- correctly, the teacher srh o u Id tell thq class; the corre c\t 
answer and ' then t ask another student »» When' the correct response 
is given, tthe tcachorj should say, '* , 

. "THAT 1 S' RIGHT . Y.OU REAL' WHAT IS IN T IT E DOTTED BOX F I UST . " 

Then t he , teacher asks , 

■ » ■ ' • ■• 

"WHAT" WILL 'YOU FIND BELOW THE DOTTED BOX, (name of a student)?" 

The teacher" calls on a student, who- should respond that you find 
questions below the dotted box. If the student does not respond 
correctly, the teacher sbioold tell "the class the correct answer 
anfl then ask anotrTer sTTudorit,. When the . correct response is 
given/ the teacher should" say, " . ' 

11 THAT ' S CORRECT / YOU W ILL FIND QUESTIONS BEL<^WJ THE DOTTED BOX . " 

■"FIND THE FIRST QUESTION . Jr'UT ^uUR PINGEIi* OS IT . u 

The teacher checks "each student to be sure he has his finger on 
the first question . . : 

"GOOD. FOR EACH' QUESTION THERE WILL' BE SEVERAL POSSIBLE 



ANSWERS. YOU ARE TO jCHOOSE T 
•FIND -A^HI: POSS IELE AS* sJwfcUS" "TO 
POSSIBLE ANSWERS ARE THERE?" 



IE BEST ANSWER TO THE QUESTION 
: HE F I RST - QUE ST ION . \lIOM*AN Y, 



J 



— J 



The .students should- respond "threes." If-' they give any other 
* 4 response , ..the. teacher' should' go to each student individually, and 
point to each possible answer as> : 'tJ;io> student" counts. » y 



so, 



"ROW LOOK bELOW EACH POSSIBLE ANSWER.- THERL IS A. DOX BELOW 
EACH POSSIBLE - ANSWER. AFTtfR. YOU DECIDE WHICH ANSWER IS ■ 
CORRECT r -YOU A KB TO MARK THE BOX BILLOW T.H^T ANSWER- NOV_ . 



PUT YO.UR FINGER BY THE SECOND ANSWER. PICK. UP . YOUR- "SPECIAL 

. ^ / . ■ " 

P.EN AND MARK LIGHTLY THROUGH THE v BOX TO SHO;W'T.HAT THE . 

. . ' ' " j' 

Second answer is- correct. " f 



The teacher ''Should check to see that each "student has marked the- 
correct space. Also the teacher should be suxo each' student 
hao made a ' wide ma rk so that the latent' image shov. T s. Any s tudou^ 
who has. not made an. acceptable mark should be required to make - ^ 

e. n clCt f J.' t. c;j J. t: ■ .iu ciik jl 1 i i» inj jj a « a. ui ujitj j_ j. .l ;r> l- uj.. liij.j. u jj i_> a 3. .u .t. -e 

answer . - \ * * " .> ^ ' 

J ■ 



"WHAT DO YOU SEE IN TllE SPACE YOU MARKED.?". . £ 

The students should say' '"stars' 1 and "very good." - , ''' 
YES."' THE STARS MEAN THAT YOU ARE THINKING'. YOU HAVE 
. MARKED THE ..CORRECT - ANSWER. THAT 1 S. WHY IT SAYS /'VERY GOOD. " 



"NOW PL 



Tv YOUR FINGER WHERE THE NEXT QUESTION WOULD 'BE . 11 



The- teacher - should check to see that each student .has* his finger 
on the correct line. j ■<.,'"' 

- ,. " "GOOD , NOW LET'S PRETEND. THAT' YOU T HTNK ■ THE ■ THIRD ANSWER ' - 

IS RIGHT . PUT YOUR FINGER BY THE THIRD ANSWER . 11 

■ » ■ 1 ■ 

The teacher. Should check / to see taht eac'n'7 s'tudent has his finger 
beside the third answer. ■ ■ 

■■ ■ .■ ..' . . ■> 

"NOW PICK UP THE SPECIAL PEN ' AND MARK LIGHTLY THROUGH 

THE BOX FOR THE THIRD ANSWER. " - . 

The t^qjher Tshould p,ause v;hile the students ■ all mark the box. 

"WHAT DOES ..IT SAY IN. THE * BOX , ^ (name^of a' 1 student ) ? : " READ - 

IT FOR U.S . 11 ■ ' 

After "the ..student reads the' message' ("Since there are: no stars, 
t^ another answer . 11 ) , the teacher ..should ■ say / . 



IF .YOUR ANSWER I S NOT RIGHT YOU 'WILL. GET SOME, .HELP ^FROM' 

■ . ■ ■ ■ 1 ■ . \ . 

HE BOX . NOW, .DO WHAT THE MESSAGE TOLD 



•THE MESSAGE IN -'T" 1 ' ^ ~~ — -~ 3 



ERjC . a '">,; ' ; . j 
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" YOU TO DO.." . . v 

T h g t e a-c h a r p a us o r- u n t i 1 a 1 1 s tu denty.-mark-either answer* one 

or t v?o ... ' " * • . 

i ■ . . *, ' ■ '* 

tf *HAT DOES IT '* SAY- [n.irae of a student)?" " ■ 

The student /should respond "excellent 1 ' or "there are stars and ; 
it says e-xcelle.T': J" •' '• - r 

• "GOOD, HOW YOU" SKT>. -THE STARS " AND YOUR ANSWER IS' CORRECT. 11 

\ • ' ■ V 

V YOU SHOULD ALWAYS HEh'O CAREFULLY. TRY -TO CHOOSE THE 

1 RIGHT ANSWER ' SO THAW "YOU CAN GET .STARS THE FIRST TIME. NOV? 



YOtlr*ARJ3 READY. TO USE 'THE LESSON BOOKLET . 



V. 



ERIC 
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Appendix II. 'Questionnaire for V.akulla Reading Project 
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- QUESTIONNAIRE FOR WAKULLA .READING PROJECT 
A. Objectives '/ 

Were. the objectives appropriate for your students? (check one) 

i - 

YES USUALLY SELDOM NO 



2. -Which objoc.tj.vpSy should be omitted? 



J 



3. What type of objectives should be added? 



4; Which objectives coincide with. those of your instructional 



■program? 



J 



'5. Much- objectives a-re irrelevant* tq. your program? 



B. Se^£-Ins-trWcticr.al- Booklets *. 



ERIC; 



1. . Does .the student find Ms own booklets/ or does rl^e teacher 
hand them to the student? (Check one) 



STUDENT' FINDS 



TEACHER FINDS 



2\ In what way, 4 if any, did a teacher or aide. assist the students 
vKn the self-instructional .boc'clets? ^(circle a letter) . 



-//a. TJ^ey^&r^iyed with the, student while he used the bod'klet. 

! . „; • - . . , : ■■ " .; 

b- They read" the directions and made sure the student knew 
what to -do. '.' • °' | - ^ 

c. They provided fee back, arid .encouragement when' students . 
" ' ./complete a booklet. * , '« 4 '.' 

■ : " ' ' • ' ■/ - " . ■ -. r ' ' ' ■ ■ /' ° • ■ ; , 

d. They merely handed, out and* cottected booklet's . .» • 



■ , ■ 7 



\ 



/ J 



3. If the student does not ■ recognize what, a picture is, do \$\\ lo 1 .! 
him what it is? j . \ : 

YCS ' "NO (check one) j / 



4. Was the format of the booklet appropriate? ,j (Check one) 
YHS NO 



; S 



If not, ivliy not and what format can you suggest? 



5. .When do the students look at the feedback? (circle a letter) 

a. after ' eacjv item ; - 

b . at the end of each page ■ * " 

c. at the end of each 'booklet ■ 

d. never \ , - "T"/ 3 *-' ^ / . , ' 

6. Do you suspect the students looked at thq feedback before -"'responding - ? 
(check one) YES * NO "~ ' " 1 i . 



If yes, is the Vfact detrimental to h.is learn nig or doe? i ; .t fro?ch" 
hira some values \yoia consider inappropriate? (circle , a letter) 

a, detrimental to '^learning j" 

b. not detrimental \ to learning A 

c* has effect on relevant values • 
d. has no effect 6n\relevant values / , 

7. Do you discuss, with the students the consequences (in learning) of 
cheating? (che^k one) 

YE S «' NO A , : , / 

8. Do you feel the booklets provided the students with needed practice? 
. '(circle a . 1 ejttcrS^. ; /• . * ~ / : 

a. too much '\ ' ' ~ ■ • . , 

b. too little ; \ / ' ' -i 

c. 7 iOt appropriate \ ■ . 



C. Tests 



I. Do you feel the pretest was successful in locating the appropriate 
'"point in the program for students, to '■egin? (check one) 

YES " NO 

. . ______ . , _ ^ ■ /A 

2: Did:'you or the students have any difficulty with, the en-lino . tests? 
(check one) 

Q ' „■ ■ -YES. ; NO - ... ;rv ' 
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If 'yes, explain :•" 



3. Did you feci the stiuTentS : "'wcre i -sp©iidii)g too much time taking 
tests? . (check one)*. „ 



NO 



TOO HW 



_ TOO FJlUQUliNT_ 



4. Do you feel" the decisions made after f e*»ch test were appropriate . 
as far as assigning students to instructional 'booklets i r s concerned? 



(check one) 

,YES 



NO 



5. J low well did the 1 0-f-f^l-in<^t^tS-7(usecl before the' computer was. 
available) work? (check one) ■ 



fioOD 



FAIR 



POOR 



6. Was it difficult to keep track of what test; or booklet a student ' 
should do next? (check one) ■ 



YES 



NO 



How did -you do it? 



What could be donu to i?ake the task easier? 

J j . 



D. Time and . Frequency • 

- ■• i . - : : . '7 

1. :llow much time did the students" o.n thfe average spend on the 

materials? : , \ ..."./. r • '.. , r f 
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TIME PER DAY 



DAYS PER WEEK , 



How did you decide when a student could do the next tq/st or 
booklet? ' 



3,i Approximately how many tests or, booklets would a -student compli^re"X7r 



one day 



in one week 



General ' ' ' . 

1. How do you feel the. project this year compares with the project 
last ^'car? (check one) : ■ 

. bkttkr ' „ about tug sAmi.; wros^ :„L." " 

2. What, do you think would be the effect of i-ewpyiiig the coiaputcr 
terminals? I „ ** 

■ \ '. * ' ,, . ' 

■ . ■ I ■ ■ . 

\ i 
\ ■" ' 

' • •" k , . 

& What is your overall opinion jpf the project? 



4. How would you describe your students 1 ; attitudes r toward, the mate rial si 



5. What do you do if the. student cannot answer the booklet questions 
in a new objective? 



/ 



5. How do you help a" child with material he has missed? 



Does your classvork revolve around. the project, 'or are the booklets 
.supplementary to the classwork, or neither? 



8. Should objective A bo before objective 3? (check one] 

YGS * NOy_ ^ ' 

9. What ^4£J^sJl ions; can you make to improve the project? 




